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ABSTRACT 

A cost effectiveness study by the Austin (Texas) 
Independent School District of its elementary compensatory reading 
programs, namely, the Chapter 1 Reading Improvement Program (Chapter 
1 Regular) and Schoolwide Projects (SVP) , found that the Schoolwide 
Projects cost two to three times as much to achieve the same gains in 
student achievement as did the Chapter 1 Regular program. Both 
procrams are funded by the Education Consolidation and Improvement 
Act Chapter 1. Both programs measure improvement in readinq skills 
with the Iowa Test of Basic Skills. The prograuns differ in the way 
that instruction is delivered. Chapter 1 students receive 
supplementary instruction from a reading specialist. SWP students 
receive all of their instruction in a classroom with students of 
mixed achievement levels, but where the pupil-teacher ratio has been 
reduced to 15-to-l. To measure achievement ge^ins, percentiles were 
converted to Normal Curve Equivalents (NCE) amd students* pra-test 
scores were compared to their post-test scores. Only teachers* 
salaries were used as the program cost. The cost per student was 
divided by the average NCE gain to obtain a cost-effectiveness figure 
that translates into dollars per NCE gain for each prograun for each 
year of implementation. A list of references is included. Statistical 
data are included on four tables. (FMW) 
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What Price Achievement: 
A Coet-Ef fectivenees Study of 
Chapter 1 and Schoolvide Projects 



Perspective 

Chapter 1 is a federally-funded compensatory education 
program created as a part of the Department of Education's 
Education Consolidation and Improvement Act (ECIA) of 1981 
(U.S. Dmartmeni: of Education). Called Title I in previous 
legislation, Chapter 1 serves educationally disadvantaged 
students who reside in school attendance areas with high 
concentrations of lowinccxse families. The emphasis of the 
proaram is on providing supplemental instruction to boost the 
achievement of children who demonstrate the most need (i«e., 
have the lovest test scores) • 

Chapter 1 participation is based on both economic and 
acadeaiic criteria. Within a district, schools which serve 
higher concentrations of lov-income families than the 
district average are eligible to receive Chapter 1 funds. 
Austin (Texas) Independent School District has two kinds of 
Chapter 1 programs: the Chapter 1 Reading Improvement 
Program and Schoolvide Projects (SWP's). 

For the Chapter 1 Reading Improvement Program (also called 
Chapter 1 Regular) in AISD, standardised test results are 
used to determine hov many students to serve at each eligible 
school. Participants are identified by ranking the students 
at each school and selecting those with the greatest academic 
need. Only students vith readino cnqprehension scores at or 
belov the 30th percentile on a standardized achievement test 
are served by Chapter 1 in AISD. Durina the 1986-87 school 
year, Chriter 1 paid for reading specialists who provided 
su|npi^Mn^>7 reading services to over 4,100 students at 32 
elementary scAiools in AISD» This program is coordinated vith 
the District's basic reading curriculum and provides 
additional assistance to students vho are deficient in oral 
language and/or reading skills. 

When the percentage of low-income families within a school's 
attendance area exceeds 75%, Chapter 1 regulations allow the 
local s^Mol district to establish a Schoolwide Project (SWP) 
in wLich the puoil^teacher ratio (PTR) is lowered to 15-to-l. 
Chapter l contributes funds for teachers based on the number 
of low acdiieverm and the district must provide matching local 
funds based on the number of non-^aiapter 1 students at the 
school » These funds are CMbined and the Chapter 1 program 
is no longer distinouishable from the regular program because 
Chapter l teachers in a SWP fimction as regular classroom 
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teach«n with studsnts of aixed achievttnent levels (and the 
lover PTR). All students at the SWP's are considered served 
by Chapter 1. 

AISD first instituted its two SWP's in 1980-81. One school 
becaae ineligible for Chapter 1 funding when its percentage 
of low-incoM faailies dropped belov the 75% level in 1984- 
85; however, the District opted to carry the entire cost of 
aaintaining the lofwer PTR at this school. This^ school 
continued to functim as a SW9, even with an adjusted funding 
source. Seeking to find a Bore effective alternative to the 
"pullout" programs irtiich cypify the Chapter 1 Reading 
Ivproveaent Prograwir AlSD^s program planners and evaluators 
turned to studies on the effects of class size on student 
achievement. The meta-ajnalysis conducted by Glass and Smith 
(1979) suggested that smaller classes facilitate student 
achievement more effectively. Furthermore r District 
administrators reas;«n«d, particularly if the PTR could be 
held down to 15-tO'l or less, many of the problems associated 
with cowMinsatory instruction (suj^lanting of regular 
instruction, disruption, diffusion of responsibility, 
negative labelling, etc.) could be circumvented or at least 
reduced (Doss « Holley, 1982). 

Co^^risons between the achievement gains of students in 
Chapter 1 Regular and the SWP's are made as a part of the 
yearly Chapter 1 evaluation in AISD. Two AERA papers which 
strongly favored SWP's were presented by District evaluators 
and desisribed the preliminary findings from these comparisons 
(Doss t Holley, 1982 and Carsrud t Doss, 1983) . The gains 
(as measured by regression analyses) made by SWP students in 
the first year of laplementation were significantly better 
than the gains ;ade by other Chapter 1 stuaents at all grade 
levels (Doss, Washington, Noede, t Mulkey. 1981) . Partly 
becauso SWP's are so expensive (they require matching 
District fluids as well as a larae share of the Chapter 1 
budget] , a longitudinal study of the program has been 
conducl:ed throughout the 1980 's to assess its impact over 
time. 

Despite the first year's substantially higher achievement 
gains for SWP students, subsequent years have not followed 
suit. Between 1981-82 and 1986-87. no consistent pattern has 
emerged to support SWP's over the traditional Chapter 1 
program (Christner, Rodgers, Fairchild, & Gutierrez, 1987). 
lach year only one or two grade levels at the SWP's could be 
shown to be superior to the comparison group served by 
ChaptiiT 1 Regular and the grade levels at which this occurred 
would vary each year. Christner (1987) offers several 
hypottieses about irtiy the SWP's may have ceased to demonstrate 
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b«tt«r achi«v«Mnt gains over other. Chapter 1 students which 
include: 

o Districtvide efforts to inprove minority student 
achieveaent, and 

o Efforts by the Department of Elementary Education and 
the Chapter 1 staff to enhance the Chapter 1 Reading 
Iiqprovement Program through better coordination with the 
regular reading program. 

Christner (1987) also suggests one likely explanation as to 
why the 81fP*s failed to produce consistently higher 
achievement gains: Simply lowering the PTR does not ensure 
achievement gains (Robinson & Wittebols, 1986) • To take 
advantage of the benefits and opportunities made possible by 
a lower PTR, teachers must alter the instructional methods 
that they use with larger classes. SWP teachers were not 

given additional staff development training on how to alter 
heir teaching and management to reflect the smaller class 
sises. 



Assuming that some type of compensatory instruction is better 
than none, the guestlon as to which method of delivering 
Chapter 1 services is superior remains unanswered • Further 
conplicating the task of making this determination is the 
realities inposed by economic hardship and fiscal 
responsibility. This study combines achievement data and 
cost information for both types of Chapter 1 programs to 
calculate their cost effectiveness* This is based on the 
premise that coiv>ensatory services must be both academically 
and economically effective if thev are to survive budget 
cuts, maintain public and professional support, and most 
importantly, serve the needs of low-achieving children in the 
most appropriate manner possible. 



Methodology/Results 

The Chapter 1 Readino Improvement Program is compared to the 
Schoolwide Projects In terms of cost effectiveness for each 
school year between 1980-81 and 1936-87. The cost- 
effectiveness analysis procedure employed is an adaptation of 
the ones established by several other researchers (Gallagher, 
19a6; Gerrits t Robbins, 1986; Levin, 1983; and Yap, 1985) 
irtio conducted similar studies. In each case, varying 
programs or instructional approaches which had common outcome 
measures (i*«*# achievement score gains) were compared on the 
basis of relative cost effectiveness. In this study. Chapter 
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1 R#9ular and thm SWP's both sarva low*- income, low-achieving 
chiloren. Both proaraas atteiq;>t to improve the reading 
skills of these students as measured by the lova Test of 
Basic Skills (ITBS) . The proorams differ in the way in which 
compensatory reading instruction is delivered. Chapter 1 
students receive siqpplementary reading instruction from a 
Chapter 1 reading specialist. SWF students receive all of 
their instruction in a classroom with students of mixed 
achievement levels, but where the PTl has been reduced to 
approximately l5-to-l. 

The 8lfP*s were iwlemented as an alternative to Chapter 1 
Regular based on the hypothesis that the reduced PTR would 
lead to superior gains on achievement tests. Chapter 1 funds 
were allocated to both programs based on the number of 
children with pretest scores at or below the 30th percentile 
(the 40th percentile in 1980-81) on the XTBS Reading Total 
subtest (Lanauage Total for kindergarteners) • Although one 
SNP school did not receive Chapter 1 funding in 1985-86 or 
1986-87, INI have included the students from this school 
because the SITP functioned in the same manner despite its 
chanoed funding source (as stated earlier, the District opted 
to pick up the full cost at this school) • Scores at this SWP 
were analyzed as if Chapter 1 were still providing services 
for the students. To measure achievement gains for this 
study, we converted percentiles to Normal Curve Equivalents 
(NCS*s) and compared participants pretest scores with their 
posttest scores on the spring ITBS tests that were taken at 
the end of each school year. Students who did not have both 
a pretest and a posttest score were omitted. NCE gains were 
calculated by averaging pretest NCE scores and subtracting 
them from averaged posttest NCE scores. This was obtained 
for each school year between 1980-81 and 1986-87. 



NCE Gains 

Chapter 1 Regular and Schoolwide Projects 
1980-81 Through 1986-87 



Chapter 1 Regular Schoolwide Projects 



1980- 81 

1981- 82 

1982- 83 

1983- 84 

1984- 85 

1985- 86 

1986- 87 



1.1 
3.2 
7.9 
6.5 
6.0 
5.6 
3.8 



.9 
-2.4 
3.8 
l.c 
2.9 
1.7 
-1.1 



Table 1. 
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Mote: Chapter 1 Regular includes all students served 

by the Chapter 1 Reading Iwproveaent Program with ITBS 
pretest scores below the 30th percentile (the 40th 
percentile in 1980-81) and ITBS posttest scores. 

Mote: Schoolwide Projects include all students served at the 
SWP's with ITBS pre- and posttest scores. 



Chapter 1 and District allocations for teacher salaries are 
used as the costs of the Chapter 1 Regular and SWP programs. 
We limited the cost to salaries because both of the Chapter 1 
programs are allotted an equivalent number of teachers (at an 
approximately equal per teacher cost) a^ determined by the 
number of students eligible for Chapter l services. At the 
schools with a Chapter 1 Regular program, the cost is for 
Chapter 1 reading specialists' salaries. At the SWP's, the 
cost is for the nuwer of teachers needed to reduce the PTR 
to approximately 15-to-l. costs for each program were 
calculated by dividing the number of students served by the 
excess amount allocated for teachers' salaries. 



1980- 81 

1981- 82 

1982- 83 

1983- 84 

1984- 85 

1985- 86 

1986- 87 



Salaries and Students Served 
Chapter 1 Regular and Schoolwide Projects 
1980-81 Through 1986-87 



Cost 



Chapter 1 Regular 

# of Students 



Schoolwide Projects 
Cost # of Students 



$1,248,635 
$1,333,735 
$1,282,322 
$1,433,548 
$1,493,942 
$2,150,821 
$1,797,462 



3,826 
3,459 
3,172 
3,017 
4,377 
4,429 
3,762 



$307,117 
$402,210 
$619,547 
$424,452 
$427,593 
$617,230 
$578,167 



1,044 
1,019 
1,083 
1,066 
794 
1,087 
1,077 



Table 2 



Mote: These figures represent expenditures for teachers' 
salaries only. In the case of SWP's, only the 
salaries for additional teachers (to lower the PTR) 
are given. 



Mote: Both local and federal (Chapter 1) costs are combined. 
Allocations for both SWP's are also combined. 
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1980- 81 

1981- 82 

1982- 83 

1983- 84 

1984- 85 

1985- 86 

1986- 87 



C09t Pttr .Stud«nt 
Chapter 1 Ragular and Schoolwlde Projects 
198U-81 Through 1986-87 



Cost/Stud«nt 
Chapter 1 Regular 

$326 
$386 
$404 
$475 
$341 
$486 
$478 

Table 3. 



Cost/Student 
Schoolwlda Projects 

$294 
$395 
$572 
$398 
$539 
$568 
$537 



Th« coat p.«r student (In teres of teachers' salaries) was 
divided by the average MCZ gain to obtain a cost- 
effectiveness figure which translates Into dollars per NCE 
gain for each prograa and In each year of laplenentatlon. 



1980- 81 

1981- 82 

1982- 83 

1983- 84 

1984- 85 

1985- 86 

1986- 87 



Relative Cost-Effectiveness Ratio 
Chapter 1 Regular and schoolwlde Projects 
1980-81 Through 1966-B7 



Cost/Student/NCE Gain 
Chapter 1 Regular 

$296 
$121 
$ 51 
$ 73 
$ 57 
$ 87 
$126 

Table 4. 



Cost/Student/NCE Gain 
Schoolwlde Projects 

$327 

$151 
$249 
$186 
$334 



Note: Ho ratio can be calculated for "negative gains." 



Lialtations 

This study Is the first to attespt a cost-effectiveness 
comwrison of cospensatory progress In AISD and has 
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sl^plifiad thm process coMid^rably. Future studies might 
match the populations more carefully by comparing Chapter 1 
Regular students to only the low*-achieving students in SHP*s« 
A cursory investigation of the MCE gains made by Chapter in- 
eligible students at the SWP's revealed slightly higher gains 
than those made by the general population at the same 
schools. The data could be further disaggregated to 
determine whether treatment effects differ by ethnicity or 
gender. 

The costs of each program are incomplete because only 
teachers* salaries were compared. A study which considers 
expenses for each program's entire budget would be more 
thorough but would not likely yield substantially different 
results. In addition, such a breakdown of costs would 
require apportionino of costs such as building use, 
program administration, evaluation, textbooks and other 
materials, craputer labs, and additional support staff. 
Judging appropriate allocations of these features would be 
difficult, especially in a longitudinal study in which 
budget records are difficult to obtain and interpret. 



Discussion 

The relative cost-effectiveness ratios (see Table 4«) do 
merit further consideration and discussion. The cost of 
attaining the same gains for SWF students is much greater 
(often two or three times greater) than the same MCE gain for 
students served by Chapter 1 Reoular. This echoes the data 
reported in Christner (1987) which compared similar low- 
acnieving students in Chapter 1 to those served in SWF's. 
Christner *s study found no consistent pattern of gains 
to the advantage of SWP low achievers over Chapter 1 Regular 
low achievers. 

Mhy have 81fP*s been continued even though the evaluation 
results after the first year revealed less positive effects 
than the relatively inexpensive Chapter 1 Regular Program? 
The main reason is the strong belief that havina fewer 
students per teacher is the single best way to improve 
achievement. This belief is prevalent not only in Austin and 
Also, but in other communities as well (Robinson & Hittebols, 
19t6)* For the lower FTR to improve academic achievement, 
instructional methods and programs must be altered to take 
advantage of this difference. In the past, AISD did not 
provide staff development for teachers on how to do this. 
Experience also shows that once schools receive additional 
teadtiers, support staff, a coi^puter lab, or other exceptional 
features, the staff and concerned community members are 
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o«n«rally unwilling to relinquish th«s« innovations. Even 
n«aativ« or indiff«r«nt evaluation results do not influence 
this preference for suppleaentary services and programs. 

In 1987-88, because of significant changes in AISD's 
boundaries r 16 eleaentary schools have high minority 
enrollaent and high numbers of low-incone families. The 
Board of Trustees committed the District to five-year 
"Plan for Educational Excellence" which is basnd on effective 
schools research and will attempt to improve the quality of 
these campuses (called Priority Schools) . To gain the 
endorsements of administrators , teachers r parents, and 
community groups, all were involved in the process of 
selecting resources irtiich wotad presumably lead to schools of 
the highest quality. Despite evaluation data indicating 
Chapter 1 Regular produced at least equal gains (at a lower 
cost) , the one feature that each group most wanted was a 
lower PTR. Consequently, the District now has 16 SWP's. 

AISD has, however, heeded the recommendations that SWP 
teachers participate in extensive staff development on 
effective use of the lower PTR. These new SWP's have a 
number of other differences from the former SWP's: they have 
more professional support staff, innovative funds for each 
campus (to spend on extra materials, staff development, 
etc.), end a strong emphasis on parent and community 
involvement. Perhaps most importantly, everyone is watching 
and waiting. Community groups, parents, the School Board, 
the principals and teachers at other schools, and the 
taxpayers In general are all watching and waitino to see if 
these new SWP's or Priority Schools produce justifiable 
results in terms of student achievement. Evaluations over 
the next five years will tell. 
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